The two phases of The Beatles

The two phases of The Beatles

In 1973, three years after the break-up of the Beatles, two compilation albums were released: The Red Album and The Blue Album. The red album contains a collection of the best songs of the 7 albums made between 1962-1966. The blue album contains a collection of the best songs from the 6 albums released between 1967-1970.

An interesting question is: “why decided Apple Records to split up the songs in two compilation albums instead of releasing one all-embracing album.” According to Mark Steffen[1], the lifetime of the Beatles can be divided into different phases. He calls the time of The Red Album a phase where the songs were “dance songs whose themes were girls and falling in love.” After this phase the Beatles changed, they only wrote songs in the studio, became more individualistic and they grew their hair. The songs in time of The blue Album had a different theme and sound as the group explored many new forms of music. The most famous example is the adding of a sitar in their song. Another possible reason is that in 1966 the so-called Studio years began. This is the period where they started to use more hours of studio time to record their album.

That the Beatles changed during their lifetime is clear, but was 1967 a clear turning point to split up the two compilation albums? Or is there a better point in time to divide their music?


Did The Beatles change over time?


Difference in mean features per phase

It is visible that some features changed a lot over time. The percentual differences of the features in the following tables the biggest were the biggest:

The biggest differences in value usable:

Feature Difference
Valence -30.5%
Energy -19.5%
Danceability -10.6%

The biggest differences in standard deviation usable:

Feature Difference
Valence 55.0%
Danceability 38.1%
Energy -29.8%

When you look to the plot it also looks like liveness, speechiness, instrumentalness and acousticness change a lot. However, when you look at Spotify’s feature distributions you only see small peaks, instead of equally distributed plots. This is the result of the fact that these features give a likelihood whether a feature is true or not. In case of The Beatles these features didn’t seem very usable. For example, the average likelihood for a liveness increased from 0.19% to 0.26%, but the Spotify site mentions that: “a value above 0.8 provides strong likelihood that the track is live.”

How did they change?

Valence, energy and danceability(size) over time per album per song

Mean Valence, Danceability and Energy over time per album.


Three interesting things are visable:
  • The valence and energy gradually become lower over time until 1968
  • The valence and energy become more spread out over time.
  • The energy and valence seem correlated

There is only one big outlier visible, Tomorrow Never Knows of Revolver. When you hear that song it indeed really sounds like an outlier because of the weard sounds in it.

The chroma analysis of Abbey Road song Come Together.


Chroma analysis of the song come together

For the following 4 pages we will dive into the song: Come Together of their last recorded album Abbey Road. We look into this song because it’s one of their most popular songs and there are different takes of it available on Spotify.

When we look at the chromagram the extracted notes are pretty good. The song is written in D-minor, which also is visible in the chroma feature. Also interesting is to see is that mainly D and C# are used a lot in the end of the song. This is correct and part of the outro that starts after 192 seconds.

Chordograms and Keygrams don’t like The Beatles


Chordogram of the song come together

When we look at this chordogram, you’ll think the key of this song is C minor or Eb major. The internet disagrees, tabs.ultimate-guitar.com says the key is Dm and also when I play along on the piano, I also think Dm is the right key.

Two possible reasons why the results are so bad in comparison to the chromagram are:

The last reason is possible because it was harder to tune your instruments in the 60s. Also, the producers speeded the songs which adjusted the key of a song.

A lot of repetition visible in the Come Together Self-Similarity


Self-Similarity Matrix of the song Come Together

In the Self-Similarity Matrix, it is visible that Come Together is a structured song with a lot of repeating parts.

Notice that:

  • The chorus of the song is fairly short, but repeats four times.
  • The chorus is also visible at the previous page at the same timestamp
  • Like in the chroma analysis and the chordogram, the outro is clearly visible after 192 seconds and repeats itself a lot.

Different takes are really different


Dynamic timewarp of two different versions of the song Come Together

The following things are visible:
  • Repetition, because several diagonal lines are visible. The are spread out over the plot because they changed the structure of the song.
  • Homogeneity, because there are a lot of big blocks visible.

In these blocks, you can see that the versions are similar but not the same.The reasons for this are that: the lyrics are a little bit different, the structure of the songs are different and less instrument were used in Take 5.

Lucy’s tempo is all over the place


Tempogram of Lucy in the sky with Diamonds

As you can see and hear, the tempo changes a lot over time. Because that it is interesting to look at the tempo detected in the Spotify features. The detected tempo is 65.09 bpm.

It’s interesting to see Spotify picked this bpm beacuse it’s not an average of the song, but just a random point somewhere during the song. The tempo changes so regularly because the meter alternates between 3/4 and 4/4. The verse is 3/4 and the chorus is 4/4.

You will not get lost in a forest

Reduced knn phase classifier

In the previous pages, differences between phases of The Beatles were shown. This raises the question: “is it possible to build a classifier to identify to which phase a song of The Beatles belongs?”

To answer this question a random forest was used to find the most important features. In the graph in the right-top, it is visible that:
  • instrumentalness
  • duration
  • c01
  • valence
are the best features to distinguish the two phases.

At the right bottom, the performance is shown. Out of 193 songs, 67 songs of the “blue” phase are classified correctly and 76 songs of the “red” phase are classified correctly. This leaves us with an accuracy of 74%.

In conclusion, you can say The Beatles changed a lot over time, but they always kept their own identity. Therefore it is logical to divide their albums into these two phases like Apple Records did because according to these most important features, their oeuvre is fairly accurately dividable into two phases.


Random forests feature importance

Performance of reduced k nearest neighbour